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DETAILED ACTION 
Response to Arguments 

Applicant's arguments with respect to the claim objections of claims 13 and 22 
have been fully considered but are moot in view of applicant's amendment. 

Applicant's arguments, see Remarks, filed 4/19/2006 with respect to the 
rejection(s) of claim(s) 1-24 under 35 U.S.C. 103(a) have been fully considered and are 
persuasive. Therefore, the rejection has been withdrawn. However, upon further 
consideration, a new ground(s) of rejection is made in view of Park (20020136449). 

Claim Objections 

Claim 6 is objected to because of the following informalities: Claim 6 recites "a 
shift resistor section..." and "...results of the shift resistor section..." However according 
to drawings and specification (Figs 7-8), applicant intends to signify a "shift register". 
Therefore, appropriate correction is required. 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 1. 7 and 12-16 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Park. (2002/0136449) 

Regarding claim 1 , Park teaches an object determination section for determining 
whether or not each pixel is part of an object to be extracted by comparing color 
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information indicating a color of the pixel with a predetermined reference value for the 
object. (p.1 paragraph 10, p. 1 paragraph 11, p. 2 paragraph 27, p. 3 paragraph 34, Fig. 
2) It should be noted that Park teaches performing matching between a pixel in the 
query image and a pixel in the object extraction target image. Additionally Park teaches 
an object information retaining section for retaining object infomriation if the pixel has 
been determined by the object determination section to be a part of the object to be 
extracted, (p. 6 paragraph 70, Fig. 2) However, Park does not explicitly teach retaining 
coordinate data of the pixel. Nonetheless, it would have been obvious to one of 
ordinary skill in the art at the present time the invention was made to utilize a feature of 
retaining coordinate data into the system of Park because pixel locations for object 
existing regions as a whole could be saved and thus, faster retrieval time can be 
achieved. 

Consider claim 7, Park teaches an object inclusion relation determination section 
for determining whether a pixel of the input image data which has been determined by 
the object determination section to be part of an object to be extracted is a new object 
which has not been detected and generating coordinate data of the pixel, (p.1 
paragraph 10, p.1 paragraph 11, p. 2 paragraph 27, p. 3 paragraph 34, Fig. 2, p. 6 
paragraph 70) It should be noted that Park teaches a final object region is determined 
when regions finally determined as a region of the object are determined as the object 
and values of pixels in final object regions are set to values of pixels in an original (new) 
image, (p. 6 paragraph 70) Furthermore, Park teaches wherein the object information 
retaining section retaining object information generated by the object inclusion relation 
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determination section for each detected object, (p. 6 paragraph 70. Fig. 2) However, 
Park does not explicitly teach retaining coordinate data of the pixel. Nonetheless, it 
would have been obvious to one of ordinary skill in the art at the present time the 
invention was made to utilize a feature of retaining coordinate data into the system of 
Park because pixel locations for object existing regions as a whole could be saved and 
thus, faster retrieval time can be achieved. 

Consider claim 13, Park teaches an object information processing apparatus for 
obtaining object information from input image. (Fig. 1 , p. 2 paragraph 24) Furthermore 
Park teaches an object determination section for determining whether or not each pixel 
is part of an object to be extracted by comparing color information indicating a color of 
the pixel with a predetermined reference value for the object. (p.1 paragraph 10, p. 1 
paragraph 1 1 , p. 2 paragraph 27, p. 3 paragraph 34, Fig. 2) It should be noted that 
Park teaches performing matching between a pixel in the query image and a pixel in the 
object extraction target image. Additionally Park teaches an object information retaining 
section for retaining object information if the pixel has been determined by the object 
determination section to be a part of the object to be extracted, (p. 6 paragraph 70, Fig. 
2) However, Park does not explicitly teach retaining coordinate data of the pixel. 
Nonetheless, it would have been obvious to one of ordinary skill in the art at the present 
time the invention was made to utilize a feature of retaining coordinate data into the 
system of Park because pixel locations for object existing regions as a whole could be 
saved and thus, faster retrieval time can be achieved. Also Park teaches an image data 
output apparatus for outputting image data into the object information processing 
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apparatus. (Fig. 1 , p. 2 paragraph 26) It should be noted that the image data output 
apparatus as taught by Park is the image input unit 110. (Fig. 1) Lastly Park teaches a 
control apparatus for controlling the object information processing apparatus and the 
image data output apparatus. (Fig. 1 , paragraph 24) It should be noted that in order for 
the object extraction apparatus to function as taught by Park, a control apparatus must 
be present for controlling the image input unit and an object position determination unit. 

Consider claim 12, Park teaches wherein object information retaining section 
retains one frame of object information of an object which has been determined to be an 
object to be extracted, (p. 6 paragraph 73, p. 2 paragraph 26) 

Regarding claim 14, Park teaches image data output apparatus is provided with 
an image pickup device for taking an object image and coordinate data of the object 
indicating a location of the object is coordinate data on the image pickup device, (p. 2 
paragraph 26) It should be noted that the image query image as taught by Park is 
obtained by photographing the image using a video editor. (Fig. 2, p. 2 paragraph 26) 

Consider claim 15, Park teaches wherein the control apparatus comprises a 
processing operation section for reading out object information stored in object 
information processing apparatus and performing a processing operation for 
recognizing an object contained in image data. (Fig. 1, p. 2 paragraph 26, p.1 paragraph 
10, p. 1 paragraph 11, p. 2 paragraph 27, p. 3 paragraph 34, Fig. 2, p. 6 paragraph 70, 
p. 6 paragraph 72, p. 3 paragraph 31. p. 3 paragraph 37) 

Regarding claim 16, Park teaches wherein processing operation section reads 
out the object information form the object information processing apparatus on a frame- 
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by-frame basis. (p.1 paragrapli 10, p.1 paragraph 11, p. 2 paragraph 27, p. 3 paragraph 
34, Fig. 2, p. 6 paragraph 70, p. 6 paragraph 72) It should be noted that Park teaches 
reading object information on an image-by-image basis and thus, frame-by-frame basis. 

Claims 3 and 23 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Park (2002/0136449) in view of Murao. (6728406) 

Regarding claim 3, Park fails to explicitly teach converting UYVY value of input 
image data to HSV value. This is what Murao teaches. (Col 11 lines 6-41, Figs 14-15, 
Fig. 6) It should be noted that UYVY is a type of YUV format. It would have been 
obvious to one of ordinary skill in the art at the present time the invention was made to 
combine the teachings of converting YUV to HSV into the system of Park in order to 
compare the HSV value of each pixel output by the image data conversion section with 
predetermined reference value to determine whether or not the pixel is part of the object 
to be extracted because HSV color space is known as an optimum color space in 
conformity with the human senses (Col 7 lines 23-24) and thus, an improved perception 
of color can be realized. 

Regarding claim 23, Park teaches outputting image data from an image data 
output apparatus to an object infomnation processing apparatus. (Fig. 1 , p. 2 paragraph 
26) Furthermore Park teaches determining whether or not pixel is a part of the object to 
be extracted and storing coordinate data of the pixel, which has been determined to be 
a part of the object to be extracted as object information on an object-by-object basis. 
(p.1 paragraph 10, p.1 paragraph 11, p. 2 paragraph 27, p. 3 paragraph 34, Fig. 2, p. 6 
paragraph 70, p. 6 paragraph 72, p. 3 paragraph 31, p. 3 paragraph 37) It should be 
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noted that Park teaches extraction of said data on a object-by-object basis by 
determining whether a region in the target image is a region of the object to be 
extracted and regions finally determined as a region of the object are determined as the 
object. Additionally Park teaches reading the object information stored in the object 
information processing apparatus using a processing operation section of a control 
apparatus on a frame-by-frame basis and recognizing an object contained in image data 
based on the object information. (p.1 paragraph 10, p.1 paragraph 11, p. 2 paragraph 
27, p. 3 paragraph 34, Fig. 2, p. 6 paragraph 70, p. 6 paragraph 72) It should be noted 
that Park teaches reading object information on an image-by-image basis and thus, 
frame-by-frame basis. However, Park does not explicitly teach converting UYVY value 
of input image data to HSV value. This is what Murao teaches. (Col 1 1 lines 6-41 , Figs 
14-15, Fig. 6) It should be noted that UYVY is a type of YUV format. It would have 
been obvious to one of ordinary skill in the art at the present time the invention was 
made to combine the teachings of converting YUV to HSV into the system of Park in 
order to compare the HSV value of each pixel with a reference value provide for an 
object to be extracted because HSV color space is known as an optimum color space in 
conformity with the human senses (Col 7 lines 23-24) and thus, an improved perception 
of color can be realized. 

Claims 8-1 1 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Park (2002/0136449). 

Regarding claim 8, Park does not explicitly teach object inclusion relation 
determination section generates four coordinate points: coordinates having maximum X, 
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coordinates having minimum X, coordinates having maximum, Y, and coordinate having 
minimum Y, where coordinate of the object are (X, Y). However Park does teach a 
rectangular region having particular size determined based on size of the bounding box 
in the query image. Examiner takes official notice that rectangular bounding boxes 
have minimum and maximum coordinates. It would have obvious to one of ordinary skill 
in the art at the present time the invention was made to utilize minimum and maximum 
coordinates in a bounding box region of Park because a set minimum and maximum 
can be used to improve the efficiency of geometrical operations by using simple 
volumes to contain more complex objects for bounding volumes. 

Regarding claim 9, Park does not explicitly teach the object inclusion relation 
determination section determines whether or not there is another pixel satisfying the 
same object condition, the other pixel is determined to be a part of the object and the 
coordinate data (X, Y) of the object is updated. However Park does teach at least one 
object position is determined (at least one object region) and the determined object 
target image then proceed to include object to be extract, (p. 3 paragraph 34, p. 4-5 
paragraph 51) It would have been obvious to one of ordinary skill in the art at the 
present time the invention was made to utilize updating object conditions for multiple 
object positions because object location information can be properly tracked in 
correspondence with a change and/or movement in location of said object. 

Regarding claim 10, Park teaches wherein pixel of the input image appears 
which has been determined by the object determination section to be a part of an object 
to be extracted and object inclusion relation determination section determines that there 
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is no pixel satisfying the same object condition, the pixel is determined to be apart of a 
newly deterred object and infomnation about the pixel is stored in the object information 
retaining section corresponding to the newly detected object. (p.1 paragraph 10, p. 1 
paragraph 11, p. 2 paragraph 27, p. 3 paragraph 34, Fig. 2, p. 6 paragraph 70) It 
should be noted that Park teaches a final object region is detennined when regions 
finally determined as a region of the object are determined as the object and values of 
pixels in final object regions are set to values of pixels in an original (new) image, (p. 6 
paragraph 70) 

Regarding claim 11, Park does not explicitly teach a condition matching flag. 
Examiner takes official notice that flags are used as one or more bits to store a binary 
value or code that has an assigned meaning. It should be noted that Park teaches 
plural object conditions, a condition for template matching as well as a condition for 
region matching. (Fig. 2, p.1 paragraph 10, p.1 paragraph 11, p. 2 paragraph 27, p. 3 
paragraph 34) It would have been obvious to one of ordinary skill in the art at the 
present time the invention was made to utiize a flag into the system of Park in order to 
indicate which object condition is satisfied as part of the object information because a 
flag may provide the funcationality of representing one of several possible states or 
statuses and to indicate the intermediate or final state or outcome of different 
operations. 

Claim 2 is rejected under 35 U.S.C. 103(a) as being unpatentable over Park 
(2002/0136449) in view of Kambayashi. (4841289) 
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Regarding claim 2. Park teaches a first to an nth comparison sections for 
determining whether or not the color information of each pixel of the input image 
satisfies a first to an nth object conditions, respectively (n: natural integer), (p.1 
paragraph 10, p. 1 paragraph 11, p. 2 paragraph 27, p. 3 paragraph 34, Fig. 2) It should 
be noted that Park teaches n= 2 comparison sections, template matching and region 
matching. However, Park does not explicitly teach an AND circuit. This is what 
Kambayashi teaches. (Col 3, lines 61-68 and Fig. 1). It would have been obvious to 
one of ordinary skill in the art at the present time the invention was made to combine the 
teachings of an AND circuit into the system of Park in order to receiving integer number 
of outputs of the first to the nth comparison sections because an AND circuit provides 
functionality such that all inputs of said circuit must be on or "logic high" for output to be 
on or "logic high" and thus, if only all input conditions, template matching and region 
matching conditions, hold true or "logic high" then the AND circuit would output a "logic 
high" to determine the final object region (Fig. 2) of Park. 

Claim 4 is rejected under 35 U.S.C. 103(a) as being unpatentable over Park 
(2002/0136449) in view of Murao (6728406) in further view of Lee (6828982). 

Regarding claim 4, Murao teaches converting from YUV to HSV (as shown in 
rejection of claim 3). However neither Park nor Murao explicitly teaches separate 
conversion tables for each component of input value in converting to H, S. and V 
values. Nonetheless Lee teaches obtaining converting to R, G, and B from separate 
color lookup tables for YV, YUV and YU respectively. (Col 3-Col 4, line 65- line 6) 
Therefore it would have been obvious to one of ordinary skill in the art at the present 
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time the invention was made to utilize the teachings of separate conversion tables for 
converting input values YUV into the system of Park with the color space conversion of 
Murao because normally color look-up talbes use two or three variable indexes, therby 
increasing memory capacity, and therefore in order to accomplish color model 
conversion with minimum memory capacity, it is necessary to properly adjust the 
numbers and sizes of color look-up tables. (Col 3 lines 28-40) 

Claim 5 is rejected under 35 U.S.C, 103(a) as being unpatentable over Park 
(2002/0136449) in view of Sasaki. (6967660) 

Regarding claim 5, Park does not explicitly teach a noise removal section for 
removing noise. This is what Sasaki teaches. (Col 4 line 60 -Col 5 line 32) It would 
have been obvious to one of ordinary skill in the art at the present time the invention 
was made to combine the teachings of a noise removal section as taught by Sasaki into 
the system of Park because the noise removal section provides the functionality of 
freely setting a LUT conversion value that realizes removal of noise occurring in a low 
brightness region, reversion of a certain tone and the like by emphasizing or reducing 
brightness values within a certain area. (Col 5 lines 28-32) 

Claim 6 is rejected under 35 U.S.C. 103(a) as being unpatentable over Park 
(2002/0136449) in view of Sasaki (6967660) in further view of Jeong. (5235650) 

Consider claim 6, neither Park nor Sasaki explicitly teaches a noise removal 
section comprising a shift register section. This is what Jeong teaches (Col 5-6 line 56- 
line 2 and Fig. 6A). Furthemore Jeong teaches determining where or not a 
predetermined number or more of a plurality of results of the shift register section are 
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equal to one another to determine whether or not plurality of results are noise. (Col 5-6 
line 56- line 2 and Fig. 6A) It should be noted that plurality of results of the shift register 
as taught by Jeong are changed from "1" to "0" in memory so to remove noise. It would 
have been obvious to one of ordinary skill in the art at the present time the invention 
was made to combine the teachings of a shift register section into the system of Park 
with the noise removal section of Sasaki in order to determine whether or not plurality of 
results are noise because a shift register facilitates in providing noise eliminating 
process carried out for all pixels of character image of each individual character. (Col 6 
lines 4-6) 

Claims 17-21, 22 and 24 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Park (2002/0136449) in view of Kamei. (2001/0046309) 

Claim 22 is similar in scope to claim 13 except for the recitation of a control 
apparatus for recognizing a behavior of the object based on the obtained object 
information. This is what Kamei teaches, (p, 1 paragraphs 9-10, p. 2 paragraph 21, p. 
2-3 paragraph 37) It should be noted that the behavior of the object as taught by Kamei 
is determining the position and size of the moving object. It would have been obvious to 
one of ordinary skill in the art at the present time the invention was made to combine the 
teachings of detecting movement (behavior) of an object of Kamei into the system of 
Park because precision tracking is achieved by performing a motion compensation on a 
preceding frame to compensate for movement of a background image of a detect 
moving object due to camera's tracking motion, (p.1 paragraph 8) 
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Regarding claim 17, Park does not explicitly teach comparing the object 
information between frames to detect movement of an object. This is what Kamei 
teaches, (p. 1 paragraphs 9-10, p. 2 paragraph 21, p. 2-3 paragraph 37). It would have 
been obvious to one of ordinary skill in the art at the present time the invention was 
made to combine the teachings of detecting movement of an object of Kamei into the 
system of Park in order to compare object movement between frames because 
precision tracking is achieved by performing a motion compensation on a preceding 
frame to compensate for movement of a background image of a detect moving object 
due to camera's tracking motion. (p.1 paragraph 8) 

Consider claim 18, Kamei teaches recognizing that object is moving in a 
predetermined direction when coordinate data of the object is changed in the 
predetermined direction between each of plurality of consecutive frames, (p. 1 
paragraphs 9-10, p. 2 paragraph 21, p. 2-3 paragraph 37). It would have been obvious 
to one of ordinary skill in the art at the present time the invention was made to combine 
the teachings of detecting movement of an object of Kamei into the system of Park in 
order to recognize that object is moving in a predetermined direction because precision 
tracking is achieved by performing a motion compensation on a preceding frame to 
compensate for movement of a background image of a detect moving object due to 
camera's tracking motion, (p.1 paragraph 8) 

Regarding claims 19 and 20, Kamei teaches recognizing that the object is 
looming toward and/or moving away from a viewing site when a coordinate location of 
the object is not changed and a size of the object is expanding and/or shrinking 
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between each of a plurality of consecutive frames in coordinate data of the object, (p. 1 
paragraphs 9-10, p. 2 paragraph 21, p. 2-3 paragraph 37, p. 4 paragraphs 68-69, Figs 
2-3) It should be noted that Kamei teaches a zooming feature, controlling zooming 
functions of the camera according to position of size of the moving object, (p. 1 
paragraphs 9-10, p. 2-3 paragraph 37) It would have been obvious to one of ordinary 
skill in the art at the present time the invention was made to combine the teachings of 
detecting movement of an object of Kamei into the system of Park in order to recognize 
object looming and/or moving away from a viewing site when size of the object is 
expanding and/or shrinking because precision tracking is achieved by performing a 
motion compensation on a preceding frame to compensate for movement of a 
background image of a detect moving object due to camera's tracking motion, (p.1 
paragraph 8) 

Regarding claim 21 , Park teaches wherein when object has at least two colors, 
the control apparatus recognizes a behavior of the object. (p.1 paragraph 10, p.1 
paragraph 1 1 , p. 2 paragraph 27, p. 3 paragraph 34, Fig. 2) It should be noted that the 
behavior of the object as taught by Park is color value of each pixel in the object image 
and the color distance between query image and object target image as taught by Park 
encompasses 3 color components (R, G, B). However, Park does not explicitly teach 
object is moved between each of a plurality of consecutive frames. This is what Kamei 
teaches, (p. 1 paragraphs 9-10, p. 2 paragraph 21, p. 2-3 paragraph 37). It would have 
been obvious to one of ordinary skill in the art at the present time the invention was 
made to combine the teachings of detecting movement of an object of Kamei into the 
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system of Park because precision tracking is achieved by performing a motion 
compensation on a preceding frame to compensate for movement of a background 
image of a detect moving object due to camera's tracking motion, (p.1 paragraph 8) 

Claim 24 is rejected under 35 U.S.C. 103(a) as being unpatentable over Park 
(2002/0136449) in view of Murao (6728406) in further view of Kamei. (2001/0046309) 

Regarding claim 24, neither Park nor Murao explicitly teaches comparing object 
information between each frame to detect movement of an object. This is what Kamei 
teaches (p. 1 paragraphs 9-10, p. 2 paragraph 21, p. 2-3 paragraph 37). It would have 
been obvious to one of ordinary skill in the art at the present time the invention was 
made to combine the teachings of detecting movement of an object of Kamei into the 
system of Park in order to compare object movement between frames because 
precision tracking is achieved by performing a motion compensation on a preceding 
frame to compensate for movement of a background image of a detect moving object 
due to camera's tracking motion, (p.1 paragraph 8) 

Conclusion 

Any inquiry concerning this communication or earlier communications from 
examiner should be directed to Kevin K Xu whose telephone number is 571-272-7747. 
The examiner can normally be reached on Monday-Friday from 9 AM - 5:30 PM. 
If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Mark Zimmerman can be reached on (571)-272-7653. 

Information regarding the status of an application may be obtained from Patent 
Application Information Retrieval (PAIR) system. Status information for published 
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applications may be obtained from either Private PAIR or Public PAIR. Status 
information for unpublished applications is available through Private PAIR only. For 
more information about the PAIR system, see http://pair-direct.uspto.qov . Should you 
have questions on access to the Private PAIR system, contact the Electronic Business 
Center (EB) at 866-217-9197 (toll-free). 



Kevin Xu 
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